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Abstract 

The distributed coordination problem of multi-agent systems is addressed under the assump¬ 
tion of intermittent discrete-time information exchange with time-varying (possibly unbounded) 
delays. Specifically, we consider the containment control problem of second-order multi-agent 
systems with multiple dynamic leaders under a directed interconnection graph topology. First, 
we present distributed control algorithms for double integrator dynamics in the full and partial 
state feedback cases. Thereafter, we propose a method to extend our results to second-order 
systems with locally Lipschitz nonlinear dynamics. We show that, under the same information 
exchange constraints, our approach can be applied to solve similar coordination problems for 
other types of complex second-order multi-agent systems, such as harmonic oscillators. In all 
cases, our control objectives are achieved under some conditions that can be realized indepen¬ 
dently from the interconnection topology and from the characteristics of the communication 
process. The effectiveness of the proposed control schemes is illustrated through some examples 
and numerical simulations. 

1 Introduction 

The distributed coordination problem of dynamical multi-agent systems has received a growing 
interest during the last decade due to the broad range of applications involving multiple vehicle 
systems. The main idea behind distributed coordination is to ensure a collective behavior using local 
interaction between the agents. This interaction, in the form of information exchange, is generally 
performed using communication between agents according to their interconnection graph topology. 
Examples of collective behaviors include consensus, synchronization, flocking, and formation main¬ 
tenance m- While multi-agent systems with general linear dynamics have been widely considered 
in the literature (see, for instance, [3HS] and references therein), coordinated control algorithms for 
multi-agent systems with double integrator dynamics have been actively studied with a particular 
interest to second-order consensus problems EHS], cooperative tracking with a single leader izmn], 
and the containment control problem with multiple stationary or dynamic leaders Despite 

their simple dynamical model, it has been shown that coordinating a team of such agents is a dif¬ 
ficult problem especially if one considers restrictions on the interconnection graph between agents 
or some constraints related to the dynamics of agents such as the lack of velocity measurements 
and/or input saturations. In addition, basic concepts from the above mentioned results have been 
successfully applied to harmonic oscillators [ms], and second-order nonlinear multi-agent systems 
with general unknown and globally Lipschitz nonlinearities |16H18] or with special models such as 
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Euler-Lagrange systems [I9U22] . attitude dynamics [23H25] and under-actuated unmanned vehicles 

[261127]. 

In this paper, we consider the containment control problem of linear and nonlinear second- 
order multi-agent systems under a directed interconnection graph. The main control objective 
is to drive the positions of a group of agents called followers to the convex hull spanned by the 
positions of another group of dynamic agents called leaders. In contrast to the above mentioned 
results where ideal communication between agents is assumed, our interest in this work is to design 
distributed control algorithms in the presence of communication constraints generally imposed 
in practical situations. Actually, the communication process can be subject to unknown delays 
and information losses, which may affect the system performance or even destroy the system’s 
stability. Also, communication between agents may not be performed continuously in time, but 
intermittently at some discontinuous time-intervals or at specified instants of time. This situation 
can be simply imposed on the communication process to save energy/communication costs in mobile 
agents, or induced by environmental constraints, such as communication obstacles, and temporary 
sensor/communication-link failure. 

Recently, various control algorithms have been developed for multi-agent systems in the presence 
of some of the above mentioned communication constraints. The authors in [28H32j . for example, 
consider consensus problems (including the containment control problem in [311132) 1 for double inte¬ 
grators in the presence of communication delays under different assumptions on the interconnection 
graph. In these papers, all agents reach some agreement on their final positions with a common 
constant final velocity provided that self delays are implemented and topology-dependent condi¬ 
tions are satisfied. Note that using self-delays requires perfect measurements of the communication 
delays. The work in [33] presents leader-follower schemes for double integrators in the presence 
of constant communication delays without using self delays. However, only uniform boundedness 
of the relative position errors between agents is reached under some conditions on the delays and 
the interconnection topology between agents. In [34], state- and output-feedback algorithms that 
achieve consensus for linear multi-agent systems with more general dynamics have been proposed 
in the leaderless case. In the latter work, the effects of the communication delays have been com¬ 
pensated using some prediction of the current states of neighboring agents obtained using their old 
(delayed) states and the constant communication delay, which is assumed to be perfectly known. 
However, achieving consensus on a dynamic final state is still a challenging problem in the presence 
of communication delays, especially, with possible information losses that prevent measurements 
of the delays. The problem becomes more difficult in the case where only partial state measure¬ 
ments are available for feedback. It should be noted that such prediction is not required in the 
case where agents are driven to a stationary position. This can be seen in the literature in consen¬ 
sus algorithms for linear multi-agent systems [351437] and some classes of nonlinear systems in the 
presence of constant communication delays [384443] and time-varying communication delays [444448] 
under undirected and/or directed topologies. Also, all the above delay-robust results for linear and 
nonlinear multi-agent systems share the common assumption of continuous-time communication 
between agents. 

In the case of intermittent communication, the authors in [49] consider first-order multi-agents 
and suggest to hold, using a zero-order-hold system, the relative positions of interacting agents 
each time this information is received. In the presence of sufficiently small constant communica¬ 
tion delays and bounded packet dropout, the proposed discontinuous algorithm in [49] achieves 
consensus provided that self-delays are implemented and the non-zero update period of the zero- 
order-hold system is small. A similar approach has been applied for double integrators in [50ll5T] . 
where asynchronous and synchronous updates of the zero-order-hold systems have been addressed, 
respectively. Using a different approach, a switching algorithm achieving second-order consensus 
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has been proposed in [52) in cases where communication between agents is lost during small in¬ 
tervals of time. The latter result has been extended to multi-agent systems with general linear 
dynamics [58] and globally Lipschitz nonlinear dynamics [54], where it has been shown that con¬ 
sensus can still be achieved under some conditions on the communication rates and interaction 
topology between agents. However, communication delays have not been considered in [50H54] . 
and it is not clear whether the methods in these papers are still valid in the case of discrete-time 
communication. More recently, based on the small-gain approach presented in |48| . a solution to 
the synchronization problem of a class of nonlinear second-order systems has been presented in 
[55] assuming intermittent and delayed discrete-time communication between agents. However, the 
result in [55] cannot be extended in a straightforward manner to the case of multiple leaders with 
time-varying trajectories. 

The main contribution of this paper consists in providing distributed containment control algo¬ 
rithms for second-order multi-agent systems under a directed interconnection topology and in the 
presence of the above mentioned communication constraints. More precisely, we consider the case 
where the communication between agents is discrete in time, intermittent, asynchronous, and sub¬ 
ject to non-uniform and unknown irregular communication delays and possible packets dropouts. 
The combination of these communication constraints implies that each agent may receive infor¬ 
mation (with delays) from other agents in the network only at the endpoints of some intervals 
of time, that we refer to as blackout intervals. Based on the small gain theorem used in our 
earlier work [48], we present an approach for the design and analysis of distributed control algo¬ 
rithms, achieving containment control with multiple dynamic leaders, under mild assumptions on 
the directed interconnection topology provided that the communication blackout intervals are finite. 
Using this approach, we present distributed containment control algorithms for linear second-order 
multi-agents modeled by double integrators with and without measurements of the velocities of the 
followers. In this case, the dynamic leaders are assumed to be moving according to some uniformly 
bounded and vanishing acceleration. Next, we present a systematic method to solve the contain¬ 
ment control problem of a network of non-identical agents with nonlinear dynamics under the same 
assumption on the motion of the leaders. The latter result is unifying in the sense that it can be 
applied to a wide class of second-order systems with locally Lipschitz nonlinearities. Then, we relax 
our assumptions on the leaders’ final states and show that our approach can be applied to solve 
the containment control problem of a class of linear second-order oscillators, including harmonic 
oscillators, under the same communication constraints. 

To the best of our knowledge, the containment control problem of linear and nonlinear second- 
order systems has never been addressed under similar assumptions on the interconnection and com¬ 
munication between agents. As compared to the relevant literature (see, for instance, [2^841491 - 154] 1. 
the proposed approach in this paper achieves our control objectives by taking into account the above 
mentioned communication constraints simultaneously without imposing conservative assumptions 
on the interconnection topology between agents. As compared to [55] that handles similar commu¬ 
nication constraints, we address in this paper the more challenging containment control problem 
with multiple leaders with time-varying trajectories. Our approach in this work is more general and 
takes into account several considerations related to the dynamics of the leaders and the followers, 
the availability of states measurements, as well as the above communication constraints, within 
the same framework. Moreover, containment control, in each of the cases in this study, is achieved 
under simple design conditions that do not depend neither on the interconnection topology between 
agents nor on the maximal communication blackout interval which can be unknown and can take 
large values. The effectiveness of the proposed containment control algorithms is shown through 
several numerical examples. 
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2 Background and Problem Formulation 

Throughout the paper, we use |a;| to denote the Euclidean norm of a vector a; € with W being the 
g-dimensional Euclidean space. We denote with Iq and Oq, respectively, the g-dimensional identity 
matrix and the zero matrix of dimension q x q, and we let Oqxp G denote the matrix of all 

zeros. We also use G to denote the vector of all ones. The spectral radius of a square matrix 
A is denoted by p{A). The Kronecker product of matrices A and B is denoted by A®B. The limit 
limt_>+oo x{t) = c is denoted by x{t) —>■ c. 


2.1 Graph theory background 

Consider a system composed of n agents that are interconnected in the sense that some information 
can be transmitted between agents using communication channels. The interconnection topology 
between agents is modeled by a weighted directed graph Q — (A/", 8, A) where each agent is repre¬ 
sented by a node and A/” := {1,..., n} is the set of all nodes. The set f G A/" x A/" contains ordered 
pairs of nodes, called edges, and A = [a^] G is the weighted adjacency matrix. An edge 

(A*) G f is represented by a directed link (an arrow) from node j to node *, and indicates that 
agent i can obtain information from agent j but not vice versa; in this case, we say that j and i are 
neighbors (even though the link between them is directed). A finite ordered sequence of distinct 
edges of G with the form (j, h), ■ ■ ■, {Iq, *) is called a directed path from j to i. A directed 

graph G is said to contain a spanning tree if there exists at least one node that has a directed path 
to all the other nodes in G■ The weighted adjacency matrix is defined such that an := 0, aij > 0 
if (j, i) G f, and atj = 0 if (j, i) ^ 8. The Laplacian matrix C := \lij\ G R"^” associated to the 
directed graph G is defined such that: la = i kj = —aij for i ^ j. That is, C :=V — A, 

where called the in-degree matrix, is a diagonal matrix with the (f,*)—th entry being la. 

In this paper, we consider the case where there exist m followers and n — m leaders (m < n). 
Without loss of generality, we let 5^ := {1,..., m} and £ := {m -|- 1,..., n} denote the follower set 
and the leader set, respectively, so that £ = A/" \ j?. Here, an agent i is called a leader, or z G £, if 
(j, i) ^ 8 for each j G A/”; a leader node does not receive information from any other node in G- An 
agent i is called a follower, or z G j?, if (j, z) G £ for at least one j G A/". Accordingly, matrices V, 
A, and C associated with G take the form 


V 

L 


1 Hmxm 


V 

Hmx m b 

' £i 




A\ 


An 


Cn 


with m := {n — m), Cl — Vi — Ai and Cn = —An- 


( 1 ) 

( 2 ) 


Assumption 1. For each node z G S', there exists at least one node j G £ sueh that a directed path 
from j to i exists in G ■ That is, for eaeh follower, there exists at least one leader having a direeted 
path to the follower. 


Consider the following definition and Lemma used in the subsequent analysis. 

Definition 1. Let Zn C R"^" denote the set of all square matriees of dimension n with non¬ 
positive off-diagonal entries. A matrix A G R"^" is said to be a nonsingular M-matrix if A ^ Z^ 
and all eigenvalues of A have positive real parts. Further, a nonsingular M-matrix A G Zn can he 
written as A = si — M for some scalar s > 0 and matrix M > 0 such that s > p{M). 
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Lemma 1. ]21[ Lemma 2.3] Consider C defined in ([2]). Under AssumptionUl the matrix Ci is 
a nonsingular M-matrix, each entry of Li is nonnegative, and all row sums of —Lf^Li are 
equal to one. 

2.2 Communication process 

In this work, we consider the case where communication between agents is discrete in time, inter¬ 
mittent, and may be subject to unknown irregular delays and information losses. Specifically, for 
each pair (j, i) S £, there exists a strictly increasing unbounded sequence C {0,1, 2, 3,...} such 
that the j-th agent is allowed to send data to the z-th agent at instants , kij G This informa¬ 
tion exchange is subject to a sequence of communication delays (Tk,,), _ 5 ,, , with S [0,-I-oo], 

meaning that the information sent by the j-th agent at can be received by the z-th vehicle at 
instant tki^ + Tk-^^. In particular, the case where = -too implies that the corresponding data 
has been lost during transmission or has never been sent. The following assumptions are imposed 
on the communication process. 

Assumption 2. For each pair {j,i) S £, there exists a strictly increasing infinite subsequence 
= {klj\,...} C such that: t —f 7”, (i+i) t.(ly ^ T , for I — I, 2,... and for some 

^ij ^ij ^ij 

T* > 0. 

Assumption 3. For all (j, i) S £, the sequence of time instants tk^^ satisfies: tk^j = kijT, kij £ ^ij, 
with T > 0 being a sampling period available to all agents. 

Assumption [2] essentially states that, for each pair (j, z) £ £, the information sent by the j-th 
agent at the instants tk^j, kij £ S^ij C . 5 ^^, are successfully received by the z-th agent with the 
corresponding communication delays. In addition, for each pair (j, z) £ £, the maximum length of 
communication blackout intervals between the j-th and z-th agents does not exceed an arbitrary (not 
necessarily known) bound T*. Assumption [3] is common in sampled-data communication protocols 
and specifies a common sampling rate to the transmitted data in the network. Note, however, that 
S^ij and S^ij are defined for each edge in £ which indicates that the information exchange described 
above is asynchronous. 

2.3 Problem statement 

Consider the n systems interconnected according to a directed graph Q, and suppose that the 
communication process between agents is as described in Section [2.21 The dynamics of agents will 
be described in the subsequent sections. For i € J\f, let pi £ denote the position-like state of 
each agent. Also, let pf and Pl be the column stack vectors of pi, z £ j?, and pi, z £ £, respectivelj0, 
and let := {Pm+i{t), ■ ■ ■ ,Pn{t)}- The objective of this work is to design distributed control 

schemes that solve the containment control problem, where the positions of the follower agents are 
to be driven to the convex hull spanned by the positions of the leaders. Formally, it is required that 

d{p^{t),C[SL{t)]) ^ 0, ioiie^, (3) 

where for a point x and a set M, d{x,M) denotes the distance between x and M, i.e., d{x,M) := 
infygM \x — y\, and C[X] := oijXj \ Xj £ X, aj > 0, = 1} denotes the convex 

hull of the set X := {xi,... ,Xp} [21]. Under Assumption jT] the result of Lemma |T] implies that 

^Throughout the paper, we use notation xf and xf to denote the column stack vectors of Xi for i € S' and Xi for 
i respectively. 


5 



— {C-i ^Hi ® In)vl is within the convex hull spanned by the leaders m- Therefore, objective ([3]) 
is reached if one guarantees that prit) + {Ci^Ci 0 lN)pL{t) —>■ 0. 

To achieve the above objective, we let the vector ) denote the information that can be 

transmitted from agent j to agent i at instant for each {j,i) € £ and kij € S^ij. In particular, 
■= [Xj(^fey), hj], where Xjitkij) is a vector, to be defined later, that contains some of the 
j-th agent’s states measured at instant , and fcy is the sequence number of transmission instants 
tkij- Accordingly, for each pair {j,i) G £ and each time instant f > 0, let denote the largest 

integer number such that P^j\k™j{t)) = [Xj is the most recent information of agent j 

that is already delivered to agent i at t. It should be noted that the number kf-{t) can be obtained 
by a simple comparison of the received sequence numbers. 

3 Technical Lemma 

Before we proceed, we present in this section a unifying result that will simplify the forthcoming 
analysis. Consider a system of n-agents interconnected according to Q and governed by the following 
dynamics 


f], = «'*, i e £, (4) 

Vi = -kr^.i-qi- 5i) + * 65 ’, ( 5 ) 

where kr^. > 0, € 7^^, i G M, is the position-like state of the i-th agent, the sets £ and j? are 

defined as above, and 6i G i G S, is the output of the following system 


Ci — (Hi ® lN)C,i ~i~ ® lN)£i ~\~ ^i,2 (6) 

5i = a(Ci® lN)C,i + (I - a)ei (7) 

~ 77 Sj=i 

for i G where Q G at G N, the vector Si G is considered as the input of system 

with ttij being the (i, j)—th entry of the adjacency matrix A associated to G and Ki ^ij 

for i G g", and the matrices Hi G Bi G and Ci G are given by 

'—hi^i hi^i 0 ... 0 0 ■ 

0 —hi^i hi^i ... 0 0 


Hi = 




B, 



0 ■ • ■ 1 hi^(j^—i 

0 ... 0 -hi^cTi- 

0 h,^a,Y,Ci=[l 0 ... 0] 


(9) 


with ..., hi^a^ > 0 and i G g. The vectors * G g, and dti, i G £, are considered as 

perturbation terms. 

In ©-©, the i-th follower, f G g, uses the received position-like states from its correspond¬ 
ing neighbors that are transmitted using the communication process described in Section 12.21 In 
particular, the vector is the most recent position-like state of agent j that is available to 

agent i at instant t. Also, the parameter a is either 1 or 0; in particular, a = 0 implies that the 
dynamic system ([6]) is not implemented. 


6 




Lemma 2. Consider the multi-agent system O-® and suppose Assumption\^ and Assumption\^ 
hold. Then, with a = 1 or a = 0, the following holds for arbitrary initial conditions: 

i) If the vectors ^i, 2 , for i G and 'i’i, for i G 2, are uniformly bounded, then Cfi Vf 
and T]p + {Cf^jC 2 ® IN)'nL uniformly bounded. 

ii) If, in addition, —>■ 0, 0, i G 'l'i(t) 0, i G 2, then Cf(0 '*7f(0 Oj 

and r}p{f) + {Cf^'C 2 ® lN)'nL{t) 0- 

Furthermore, if the conditions in item i) hold and the perturbation terms $i,i, ^i, 2 , for i G^, and 
'^i, for i G 2, do not converge to zero, then the effects of these perturbation terms can be reduced 
with a choice of and the entries of Hi provided that T* is sufficiently small and/or Tjp/) is 
slowly varying. 

Proof. See Appendix El □ 


4 Containment Control of Double-Integrators 

In this section, we consider the multi-agent system governed by 

Pi = Vi, Vi = Fi, i G Af, (10) 

where Fj, for z S is the input vector for each follower, and F^ for z G £ is a function chosen such 
that each leader evolves with some bounded acceleration and all the leaders converge asymptotically 
to a common steady state velocity. Specifically, we consider the following assumption. 

Assumption 4. For all i G 2, Ti is a uniformly bounded function such that the state Vi in m is 
uniformly bounded and v/f) —>■ 0, v/f) G for arbitrary initial conditions. 

Also, we assume that Xjitkij) ■= where pj is the position of agent j for 

j G N, Vj = Vj, for j G 2, and Vj, for j G if, denotes a velocity estimate obtained by the j-th 
follower according to an algorithm described below. Using this information exchange, we consider 
the following control input for each follower in m 

Fi = -kd/vi - Vi) - kp/pi -/i) 

Vi = ~Lpi (vj ~ ~ OijVji^kPJt))] 

for i G where the vector ipi is given by 

1 " 

'0i = — ^ ^ Ojj {vj/k’p.it)) + %(^feg(t)) ■ {t ~ kij{t)T'^ (13) 

* 1=1 '---' 


( 11 ) 

( 12 ) 


and kp^, kdi, Lp., z G S', are strictly positive scalar gains, Oij is the (z,j)-th element of A, and 
Ki := ^ij * G S satisfies Ki / 0 in view of Assumption [T] The term in (USD can be 

regarded as an estimate of the current position of the j-th agent, for (j, z) G £. This term is based 
on the most recent information of the j-th agent available to the z-th agent at instant t, and depends 
on the common sampling period T, which is available to all agents as per Assumption [3l 

It can be noticed that the control law (HID-dlSl) might be discontinuous in the presence of 
the irregularities of the received information due to the communication constraints. To ensure a 
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continuous-time control action, the received information can be moved one integrator away from 
the control input by letting the vector 'ipt in m be the solution of the following dynamic system 


ipi 








■Vi, 


i e 


i=i 


(14) 


with k,jj. > 0, and Vi, dij given in (HHi-dlSl)- 

In the case where the velocity vectors Vi for i G ^ are not available for feedback, we consider 
the following control algorithm 

= -kdMi + Pi - Vi) - kpXpi - i’i) 

= -(<(>*+Pi) + hi 

for i £ where Vi, i £ J\f, and ij^i, i £ ^, are defined in (HH) and m (or (HI), respectively. 

The signals ipi and Vi in (fTTl) (and in (fT^ l can be considered as a reference position and a 
reference velocity for each follower agent. The dynamic system (HU), acting as a distributed observer, 
is introduced such that all followers reach some agreement on their velocity estimates in the presence 
of communication constraints. For this, the velocity estimates Vi, i £ A/", are transmitted between 
agents instead of the actual velocity vectors. In contrast, the reference position ipi in (I13p (or 
in (1141) 1 depends on the received positions of the corresponding neighboring agents. The signal 
(pi £ is used in dig to cope for the lack of measurements of the velocity signals Vi, i £ ^. 
The control input T^ in (fTTl) (respectively, in (fT31) - (fTOl) l is designed such that each follower tracks 
its reference velocity and reference position (respectively, without measurements of the followers’ 
velocities) in the presence of the communication constraints described in Section 12.21 This can be 
shown using the small gain framework (Lemma [2) as stated in the following result. 

Theorem 1. Consider the network of n systems described by m and suppose Assumptions 013 
hold. For each i £ ^, consider the control input (Hg-dni) with dig or dig. Pick the gains kp^ and 
kdi such that the roots of +kdiX+kp. — 0 are real. Then, the vectors vp, vp, \ip + {Cf^C 2 ®In)'Pl 
are uniformly bounded, Vi{t) —>■ Vd, for i £ ^, and pp{t) -|- {Cf^C2 (8i/Ar)pL(t) —t 0 for arbitrary 
initial conditions. 

Furthermore, ifTi{f), i £ 2, does not converge to zero, then, the effects ofTi,i£2,,on the error 
signal pp + (£("^£2 ® In)Pl can be reduced with a choice of Lp^, kp. and kd^ provided that T* is 
small and/or the signal v/t), i £ 2, is slowly varying. 

The same above results hold when using the control input dig-dig with m and dig or dig. ■ 

Proof. Consider the dynamics of the distributed observer m with Vi = Vi for i £ 2, which can be 
rewritten as in (|4|)-(l8]) with a = 0. Then, one can show, using Lemma with Assumption [2] and 
Assumption m that vp, vp + (£("^£2 ®In)vl are uniformly bounded and asymptotically converge 
to zero for arbitrary T* > 0. Then, Vi, i £ ^, is uniformly bounded and Vi{t) Vd, i £ 1?, since 
Vi{t) Vd, i £ 2, and the row sums of —£("^£2 are equal to one (by Lemma [1]). In addition, if 
Vi{t), i £ 2, does not converge to zero, then one can show, using Lemma [H that the effects of a 
non-vanishing v/t), i € £, on the error signal Vp + (£(”^£2 I]\j)vp can be reduced with a choice 
of Lp. provided that T* is small and/or Vi{t), t G £, is a slowly varying signal. 

Consider system dig with dig, which can be rewritten as 

Vi = -kdi {vi - Vi) - kpi {pi - Vi) -I- Ei 
Vi = aipi + Z)"=i dijidij 

tpi = -fcV’iV’i + ^ Z)"=i 
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(15) 

(16) 


(17) 

(18) 
(19) 



for i £ where a = 0 or a = 1 correspond, respectively, to using (USD or da, and Ci = 0. For 
analysis purposes, suppose that is uniformly bounded and —>■ 0. 

Let —Xi < 0 be one of the real roots of + kfx + kf = 0, for i € S'. Consider also the new 
variable = -^{vi — Vi) + Pi, i £ d, which, in view of (USD and (ED, satisfies 

ii = kdiivi - Vi) - kp,{pi - Vi)j +Vi - ^^{vi - £i) 

= ~ ^ 5^’ (20) 

k 

where the last equality is obtained using the relations Pi = Vi = Xi(^i —Pi) + Vi and 
which hold from the definition of ^i and A^, respectively. 

Now, define pi = {pi - Vdt) for i £ N, and - Vdt), ipt = (V’i - Vdt), Pi = {vi - Vdt), for 

i £ S. Then, using (|T(ID and (fT71) - (P(ID . one can show that 


Pi = Vi - Vd, _ i £ Z 

Pi = -Xi(pi-^i)+Vi - Vd, t e S, 

with 

- —k . - 1 • 

= -^^i(i-Pi) + Vt-Vd-—{vi-ei) 

Aj Ai 

1 ^ 

Di = aijji + (1 - d)( — + 0^,i) 

J = 1 

1 ^ 

A = -k^^ (jji -^ aitPi(4g(t))) + 0i,2 

and 

0i,i = ^ E"=i a-ij {(vjitk’ppt)) - Vd) ■ {t - fc“(t)T)) 

6i,2 = k^iQi,i +Vi-Vd 

for i G S- It is then clear that for d = 0, the closed loop dynamics (EID-dSSD can be written in 
the form (HD-dlD with a = 1 and Ci = 1, for i G S- Also, for d = 1, system (l2T]) - (l25]) is equivalent 
to (HD"(ED with a = 1 and ai = 2, for i G S- Therefore, the result of the theorem can be shown 
by verifying the conditions in items i) and ii) of Lemma [2] By Assumption |4l we know that pi is 
uniformly bounded and pi(t) —> 0 for i £ Z. Also, we have shown that Vi, Vi are uniformly bounded, 
Vi{t) -£ 0, and Vi{t) — Vd ^ 0 for all i £ This, with the fact that tfef'(t) = k™{t)T -£ +oo and 
{t — k™{t)T) < T*, in view of Assumption El lead one to conclude that ©i^, 0^,2, in (ESI) , are 
uniformly bounded and 0i,i(t) —0, 0i,2(O 0, for i £ ^. 

Invoking Lemma El we can show that p;,, pf + {Ci^jC 2 C) In)pl are uniformly bounded 
and PF(t) —>• 0, PF(t) + {Z^^jC 2 (8) / 7 v)pL(t) —>• 0, as t ^ +00 for arbitrary initial conditions 
and for arbitrary T* > 0. Consequently, Uj, (vi — Vd) are uniformly bounded and Vi{t) -£■ 0, 
{vi{t) — Vd) ^ 0, i £ S- Also, since all row sums of —£^^£2 are equal to one (see Lemma ED, 
we can show that pf + (£^^£2 <8 !n)Pl — Pf + (£^^£2 <S> In)pl, which leads to the conclusion 
Pf + (£^^£2 0 ^n)pl is uniformly bounded and PF(t) + (£^^£2 <8 /Ar)pL(t) —>• 0. 

In the case where Vi, i £ Z, does not converge to zero, we know that Vi — Vd, Vi, Oi,i, and 0i,2, 
i G 5^, do not converge to zero. As discussed above, the effects of a non-zero Vi, i £ Z, on Vi — Vd 
and Vi, i £ d, can be reduced with a choice of Lp. for small T* and/or a slowly varying Vi{t), i £ Z. 
Similarly, one can deduce from Lemma El that the effects of non-zero Vi — Vd, Vi, ©i.i, and 0i,2j 

A _i k 

I G S', on Pf and Pf + {£i £2 0In)pl can be further reduced using the gains Xi and for small 


( 21 ) 

( 22 ) 

(23) 

(24) 

(25) 
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T* and/or a slowly varying Vi{t), i G £. 

Finally, in the case where Vi, i G are not available for feedback, applying the control algorithm 
(fTKll - lfTHll with (fT^ and (fT^ (or ([Mil l to (ITOl) . i G^, leads to the closed loop dynamics 

Vi = -kdi {vi - Vi) - kp. (pi - Vi) - kp^i 
02 — 02 


where (j)i := (j)i + Pi — Vi, i G and Vi is given in dUD-dni), for i G Then, the results of the 
theorem can be shown following the same arguments as above by letting := —kd^(j)i in (HZl). □ 

In the case where the steady state velocity of the leaders Vd is available to all the followers, the 
distributed observer (HU is not required and the following Corollary can be proved using similar 
steps as in the proof of Theorem [1] 

Corollary 1. Consider the multi-agent system m and suppose Assumptions{Tl^hold. For each 
i G consider the control algorithm (El) with (ED (or (1141) ) by setting Vi = Vd for all i G Also, 
suppose that the control gains are selected as in Theorem{J\ Then, vp, vp, pp + (£(”^£2 'SiIn)pl 
are uniformly bounded, Vi{t) —>■ Vd, for i G and pp{t) + (£("^£2 0 lN)PLit) — 5 - 0 , for arbitrary 
initial conditions. The same results hold when using the control input (EJ-dlll) with (US ( or da/. 

Remark 1. Note that, in the special case of multiple leaders with zero steady state velocity, i.e., 
Vd = 0, or stationary leaders, i.e., Vi = 0 for all i G 2, Assumptions^ is not needed in CorollaryS^ 

The containment control problem for double integrators (flOl) has been addressed recently in 
m and |32j assuming continuous-time communication in the presence of uniform communication 
delays. With the assumptions that the leaders’s velocities are constant and the communication 
delays are smooth and can be measured, objective |3] is achieved in [31], using a state feedback 
algorithm, under some conditions directly related to the interconnection topology between agents, 
the upper bound of the communication delays, and the solutions of some LMls. A similar result is 
obtained in |31l32j in the case of constant communication delays. In contrast, the distributed control 
algorithms in Theorem [T] achieve objective ([3]) under weaker assumptions on the communication 
between agents, that can be subject to unknown, non-uniform, and irregular communication delays 
with possible packets dropouts, and, in addition, remove the requirements of velocity measurements 
for the followers. Further, the above results solve the containment control problem for multi-agent 
system (nni), with multiple dynamic leaders satisfying AssumptionjTl under a simple condition on the 
control gains. Interestingly, this condition is topology-free and does not depend on the “unknown” 
maximal blackout interval T* that may take arbitrarily large values. 

5 Containment Control of Nonlinear Second-Order Multi¬ 
agents 

In this section, we consider the case where the dynamics of the followers are non-identical and 
satisfy 

Pi{t)=Vi{f), Vi{t) = Fi{pi,Vi,Ti), iGJV, (26) 

where the functions Fi : x x R^ —>• R^, for i G are assumed to be continuous and locally 

Lipschitz with respect to their arguments, and Fj = F^ for i G 2. 

Similarly to the previous section, we suppose that Xj(.tkij) ■= [Pjitki,j),Vj{tkij)], where Vi, i G^, 
is a velocity estimate obtained using a distributed observer described below and Vi = Vi, i G 2. 
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Assuming that the velocities of the followers are available for feedback, we define a reference velocity 
signal for each follower as follows 


Vr^ ■■= - r]i,l) + Vi, 


(27) 


where Ai > 0 and rji, Vi satisfy 



for i G S', and where kp^, kd^, Lp., Ld^, i G S, are strictly positive scalar gains, '&ij is given in ((T51) . 
and Gij, Hi are defined as above. 

The main idea behind the introduction of the reference velocity is different from that of 
the approach used in Section 0] This reference velocity is generated for each follower in (HH) using 
the states of the dynamic auxiliary systems (EHl)-®- The structure of these auxiliary systems 
is motivated by the result of Lemma [5] that is proved in Appendix based on the small-gain 
framework. We will show in Theorem below that all followers coordinate their motion with 
respect to the leaders’ trajectories if there exists a tracking control input T^ in (PSI) . i G S’, such 
that each follower tracks its corresponding reference velocity. 

Theorem 2. Consider the multi-agent system (1261) and suppose that Assumptions\Tl^hold. For 
each z G S, consider the reference velocity given in (|27|-(|2^ and suppose that there exists a 
control input T^ that guarantees: 

i) The error vector a := Vi — Vn, z G is uniformly bounded. 

ii) If Vn o.nd are uniformly bounded, then ei(t) 0. 

Then, Vp, pp-\-{Cf'^ C2 ®In)'Pl o,re uniformly bounded, Vi{f) —>■ Vd, fori G S, and p p (t) £2® 

lN)PL{t) —t 0 for arbitrary initial conditions. I 

Proof. First, it can be verified that the distributed observer (1^ with vt = Vi, i G 2, can be 
rewritten as ([n])-([S]) with a = 1 and CTj = 1, for i € Therefore, Lemma[5]can be used to show that 
Vp, Vp {£^^£ 2 ^ In)vl are uniformly bounded, vp{t) 0 and vp{t) {£^^£2 'SilN)vL{t) —>■ 0, 
in particular (t) — —)• 0 z G under Assumption [TJ Assumption [5] and Assumption 2] 

Next, define the following variables: pi = (pi — Vdt), for z G M, pi^i = {rji^i — Vdt), and pi ^2 = 
(z?i ,2 — Vdt), for z G S'. The dynamics of these variables can be shown, after some computations 
using (EZl-dlSl), to satisfy 


Pi = Vi- Vd, i G £, 

Pi = -Xi{pi - pi^i) -\-Vi - Vd + Ci, z G S, 


(30) 




— kpjN 

kpjN 

Vi,! 

.Vi,2. 


Oat 

—kdjN_ 

.Vi,2. 


-k 




Vi - Vd 

aijPj{tkf:{t))) + ©i 


(31) 


for z G S, where 0i := kdiOi.i + Vi — Vd, with 0i_i being given in (1^51) . It can also be verified that 
(I5ni) - (PT]) is equivalent to ([S])-® with a = 1 and ai = 2, for z G S- From item z) in the theorem. 
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we know that there exists an input r^, i S 5^, such that is uniformly bounded, i G Also, 
Assumption |4] implies that pi is uniformly bounded and pi{t) —>■ 0, i S £. Note that we have shown 
above that Vi, Vi — Vd, i G are uniformly bounded and asymptotically converge to zero. This 
with tfeg(t) —t +00 and (t — fc“(t)T) <T*, by Assumption [2 one can deduce that 0i is uniformly 
bounded and Qi{t) 0, i G d- Invoking Lemma [U we can show that pi^ 2 , Pi, i G and 

Pf + ® Iw)Pl are uniformly bounded. Consequently, and v^, i G are uniformly 

bounded. Then, item ii) in the theorem leads us to conclude that ei{t) —>■ 0, i G S'. Invoking 
Lemma [2] again, we can show that Vi{t) Vd, i G S, and Pf(0 + {C'P^C 2 ® lN)pL{t) —>-0. □ 

Remark 2. Similarly to Corollary\l\ the result in Theorem\^can be simplified in the case where the 
steady state velocity of the leaders qd is available to all the followers, or is null, by letting Vi = Vd 
for all i G d- 

Theorem [2] shows that the containment control problem of the general class of nonlinear systems 
(1261) can be achieved in the presence of unknown communication blackout intervals that can be 
arbitrarily large. Note that the reference velocity v^ in (l?71) depends on the states of the nonlinear 
system (I26L which introduces some coupling between the dynamics of this reference velocity and 
the tracking error = {vi—Vrfi. Theorem [2] takes into account such coupling and provides sufficient 
conditions on the control input Tj, f G S, such that tracking the reference velocity (OTll - d^ leads to 
our control objectives. Keeping in mind that v^, Vn are well defined continuous functions of time 
and available for feedback, the design of such control input T^ would be possible following the various 
approaches dealing with tracking control design for nonlinear systems. It is worthwhile mentioning 
that a similar approach has been recently considered in [55] to address the synchronization problem 
of multi-agent system (j26p under similar assumptions on the communication constraints. The 
distributed design of the reference velocity in Theorem extends our results in [55] to the case 
of multiple dynamic leaders with time-varying accelerations. Moreover, the algorithm proposed in 
Theorem [2] is structurally simpler (as compared to the one proposed in |55] 1 and, in addition, our 
control objectives can be attained without imposing any conditions on the control gains. 

To illustrate the application of Theorem we consider the following dynamics of nonlinear 
systems 

Fi{pi,Vi,ri) := Fi{pi,Vi)+Ti, for f G S', (32) 

where Fi : x —>■ R^, is a locally Lipschitz continuous function satisfying the following 

assumption. 

Assumption 5. For all i G there exists known class-Koo functions <5^. and d'j. such that 

\Ffip„Vi)\ < S’'j.{\p,\) + Sffi\vi\). (33) 

For each follower in ([32|l , consider the following control inpnt 

f = / + 

* 1 0, ifei = 0 

where kr^ > 0, = {vi — Vrfi, Vn is given in (l?f)) - (l^ . Note that the control algorithm (IMl) is a 

classical variable structure controller that satisfies the conditions in Theorem [2] for a given and 
Vri- In fact, using the Lyapunov function Vj = 0.5eJCi whose derivative evaluated along the closed 
loop dynamics satisfies Vj < —2krfVi, one can show that Ci is uniformly bounded and efit) —>• 0 for 
all i G d- Therefore, the following corollary of Theorem [2] holds. 


(34) 

(35) 
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Corollary 2. Consider multi-agent system (1261) with (|32l) and suppose that AssumptionslTli^hold. 
For each follower, let the control input be given in (Isll)-® with (I27|) - (l29p . Then, vp, P_f + 
{Cl C2®In)'Pl are uniformly bounded, Vi{t) —>■ Vd, for i € d, and pF{t) + {Cf^C2®lN)pL{t) —s- 0, 
for arbitrary initial conditions. I 

Remark 3. In 15^ . an ISS method has been proposed to solve the containment control problem 
for nonlinear multi-agent system (12611 . with (13211 and Assumptions^ where only the ease of sta¬ 
tionary leaders has been considered using continuous-time communication between agents and no 
communication delays. The result in m is achieved under sufficient conditions given in terms of 
a number of inequalities that depends on the number of the directed paths and cycles in the directed 
interconnection graph between agents. Besides the fact that we consider communication constrains 
and non-stationary leaders, the results in Corollary\^do not rely on any centralized information on 
Q, and hold in the presence of unknown bounded blackout intervals that can be large. 

Remark 4. The result of Theorem\^can be applied to various other nonlinear second order systems, 
including mechanical systems, which need not to be identical. 


6 Containment Control of Oscillator Systems 

Consider a multi-agent system where the dynamics of each agent are described by 


Pi = Vi, Vi = SiPi-\-S2Vi-\-ri, ieAf, 


(36) 


where is the control input and Si G , S 2 G are known matrices. Let = 0, for 

i G £,, and consider the following assumption. 


Assumption 6. All eigenvalues of S are pure imaginary and semi-simple, with S := 


Ojv 


In 

S 2 


Assumption [5] implies that all agents oscillate with some frequency and some amplitude defined 
by their initial states if subject to no input. It is clear that Si = S 2 = On corresponds to the 
case of double integrators studied in SectionH) Also, if = diag{—sip,..., —si, 7 v}, sij > 0 for 
j = 1,... ,N, S 2 = On, the dynamic system (l36l) describes a group of harmonic oscillators studied 
in [UlIilliTllSH]. In this section, we design the input of the follower agents such that their final 
trajectories are driven to the convex hull spanned by the trajectories of the leaders in the presence 
of communication constraints. 

Let the control input in (I5S1) be as follows 


Li = -{kdjN + S2){vi - Vi) - kp,{pi - ifip) + 2ai 
CTi = Si{vi - Vi) -G S2<7i - kdidi - kp^{vi - V'i.2) 

Vi = SiPi-G S2Vi + ai 


for i G^, where kp^ > 0, kd^ > 0, and the vector ifi := ^ ^ 2 Nx 2 N ga^isfies 


V’i 


1 Pj{ikfAt)) 

— } a^jC 'A’ 


(37) 

(38) 

(39) 


(40) 


with Vi = Vi, for i G £. The vector xfi in (1401) is defined based on an estimate, or a prediction, of 
the current positions of neighboring agents obtained using the most recent information available 
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to agent i at t. Also, similarly to the control algorithm the vectors and vt can be 

interpreted as a reference position and reference velocity, respectively, for each follower designed 
to achieve our objectives. However, the dynamic system dSHli-dMl), i G with Vi = Vi, i € £, 
cannot be seen as an independent distributed observer since it relies on the positions of the agents 
in dsni) and (HUl) . In fact, the control algorithm (l571) - (Hni) does not reduce to CD-dlSl) in the case 
of Si = S 2 — O^v- 

In the case where the velocity vectors Vi for i G are not available for feedback, we implement 
the following control law for each follower 

Tj = -{kdjN + S2){k^i{(l)i +Pi) - Vi) - kp.{pi - ipi^i) + 2ai 
di = -{kdjN - S2)(Jr + Si {k^, {ipi + Pi) - Di) - kp, {vi - '0i,2) 

4>i = -{k^jN - S2){pi + (t>i) + + ‘5'iP*) (41) 

with k(in > 0 and Vi, -0* := '^ 7 , 2 )'^ being defined in (|5^ and (HOI) , respectively. 

Theorem 3. Consider the network of n systems described by (1361) and suppose Assumptions]^ 
and Assumption]^ hold. For each i G consider the control input (l37l) - (l40t . Pick the gains 
kp. and kd.,^ such that the roots of + kdiX + kp^ = 0 are real. Then, all signals are uniformly 

bounded and vp{t) + {Cf '^C2®lN)vL(t) 0, PF{t) + {C.i ^C2 ®In) Pl(1) 0, for arbitrary initial 

conditions. The same results also hold in the case where the control algorithm dm with dm-dini) is 
used provided that the matrix {—k,p.lN + S 2 ) is stable. M 

Proof. Let Xi = {pj,v7)^, i & M, Zi = ((ui — Vi)^,a7)^, * G 5^, where Vi = Vi for i € £,. Then, 

one can verify, from (l36l) with (l37l) - (l40l) . that Xi = Sxi, i € £,, and 


- V _r - 1 ^ (42) 

^i — ^Zi kd,^Zi kp^yXi Yi) F ^i 

where ipi is defined in (HOI) and = 0. Similarly to the proof of Theorem [U we suppose that is 
uniformly bounded and ei(t) —>■ 0 for analysis purposes. In view of Assumption |6l we consider the 
following change of variables Xi{t) = e~^^*~F')xi{t), ior i € M and t > to > 0, and define similarly 
Zi{t), 0i(t), ei{t), for i € This leads to 


with 


Xi 

Zi 



= Zi 


= -kdiZi - kp.[xi - Ipi) + Ei ’ 

Sj=l ®b%(^/cg(i))- 


* G d 


(43) 


Now, to use the result of Lemma [2l we consider the change of variables fi = j-Zi + Xi, where 
—Ai < 0 is a real root of the characteristic equation given in the theorem. Then, one can show, 
using similar steps as in (uni), that 


with 


Xi = 0 i € £ 

Xi — \i]Xi fi) ? G 


ii 


kpi 


A. 




1 j T 

~ X/ “b%(^fe'5(b)) + 

3=1 



(44) 


(45) 
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for i € Then, since the dynamic system (l44l) - (l^ can be rewritten as (|4])-® with a = 1 
and ai = 1, i € Lemma [2] can be used to show that xp, xp + ® In)xl are 

uniformly bounded and asymptotically converge to zero under the assumptions of the theorem. 
This implies that Zp, Zp are uniformly bounded and Zp{t) —>• 0, Zp{t) 0, in view of (|i51) . 
This, with Assumption [6l leads to the conclusion that zp, zp, xp, xp + {£^^€2 <8) In)xl are 
uniformly bounded and asymptotically converge to zero, which leads to the result of the theorem 
from the definition oi zp and xp. Also, ojf is uniformly bounded since xp is uniformly bounded 
by Assumption |6l 

In the case where the control law (1411) is used, we define the error vector (pi := (pi + Pi — -^Vi. 
Using dMl) with dm, one can show that 


pi — S2}Pi^ 

for i € This implies that pi{t) —>■ 0 exponentially if — S2) is stable. Also, by noticing 

that Vi = kp.{pi + Pi — pi), and using the same variables Xi, Zi, defined above, the closed loop 
dynamics (l3^ with m, dMj-dlOl), can be written as in (I44l) - (l45p with := 

—kp)^{kd.I]sf + S 2 )pi, and ep 2 := kp.Sipi. The same above arguments can then be used to prove 
the last part of the theorem. □ 

Theorem[3]provides a solution to the containment control problem of linear oscillators (1361) under 
relaxed assumptions on the communication process between agents (leading to unknown commu¬ 
nication blackout intervals that can be arbitrarily large) without imposing additional restrictions 
on the directed graph. This is guaranteed with a simple choice of the control gains despite the 
oscillatory motion of all agents. Further, the above result removes the requirements of velocity 
measurements for the followers. It is clear that the distributed control algorithm in Theorem [3] can 
be applied, with an obvious modification, to the case where the leaders’ trajectories are oscillating, 
according to (133)) with Assumption [31 and the follower agents are governed by double integrator 
dynamics (ITUl) and/or the nonlinear second-order dynamics (1331) . 

Remark 5. The synchronization problem of harmonic oscillators has been addressed in the litera¬ 
ture in both the leaderless and leader-follower scenarios in the case of continuous-time communica¬ 
tion and in the case where communication is lost during some intervals of time in- More 

recently, the containment control problem of coupled harmonic oscillators in directed networks has 
been studied in using sampled-data protocols. Communication constraints, however, have not 
been considered in these papers and only the case of undirected interconnection graphs is addressed 
in [ 57 | /. 

7 Simulation Results 

In this section, we implement the proposed distributed containment control schemes for a network 
of ten systems, with ^ = {I,..., 6} and £ = { 7 ,... , 10}, moving in the two dimensional space with 
N = 2. The communication process between agents is described in Section [3^ with the parameter 
T* in Assumption [3] being estimated to be smaller than or equal to 1.5 sec, and the interconnection 
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graph Q is directed and satisfies Assumption [T] with 
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Also, we let pi = (pidPis)"*" G G and the vector Vf- denote the containment 

error of the system defined as vr = ,..., := vp + (£^^£2 ® 12 )vl, where vp^ = 

{vp.^,Vp.^y G * G S'- 

Example 1 : We consider the follower agents modeled by (US and the motion of the leaders is 
described by Vi{t) = Vi{0) + l 2 (—1)* (cos(t) — 0.2sin(t)) for i G £, with Vi(0) defined such 

that Vi(t) —?> (1,0.1)^, for i G £, such that Assumption 2] is verified. We implement the control 
algorithm (fTT|)-(fTSl) in Theorem [T] with the control gains kp. = kd- = Lp^ = 4, i G S- In the 
case where the velocity vectors Vi, i G are not available for feedback, we implement the control 
algorithm (I15l) -(ll6 p with (1121) and (HI with the same above gains and k^^ = 1. It can be verified 
that, in both cases, kd^ = 2^kp. and hence the condition in Theorem[T]is satisfied. 

Fig.[T]shows the convergence of the containment error vectors for all followers to zero in the case 
where control algorithm dm)-(HU) of Theorem [1] which implies that all followers converge to the 
convex hull spanned by the leaders using intermittent discrete-time communication, in the presence 
of time-varying delays and packets dropouts. This is also demonstrated in Fig. O which depicts 
the trajectories of all agents at different instants of time in this case. The same conclusions can be 
drawn from Fig. [3] showing the results obtained in the partial state feedback case. Note that the 
trajectories of the leaders are the same in both cases and the trajectories of the followers are shown 
only in Fig. [3] for clarity. 

Example 2'. We consider the case where the followers are governed by the nonlinear dynamics (I26p 
with (1321) . In particular, and similarly to [56) . we let 

F,{pi,Vi,r,) =ri +, iGS, 

which satisfies Assumption [3] with 6^.{\pi\) = 0 and (|ui|) = |uip. Then, for all follower agents, 
we implement the control algorithm described in Corollary [2] with the control gains k^ — 1, Xi = 2, 
kp^ — kd^ — Ep^ = Ld^ ~ 'I G 

To validate the result in Proposition ??, we assume that the leaders can transmit their informa¬ 
tion, using the same communication process, under the directed interconnection graph having 
the set of edges = {(7, 8), (8, 9), (10, 7)}, which is a spanning tree rooted at node 10. Then, we 
implement the algorithm in Proposition ?? with arbitrary initial conditions of the leader agents and 
Vd{t) = (Ij 0.1)^ -|- (cos(t) — 0.2 sin(t))e“°-^* m/ sec. Also, the control gains are selected as: kd^ = 4, 
i G £, kp^ = 4, = 1, i G {7,8,9}. The desired separation vectors between the leader agents are 

considered as 5ij = Si — Sj, with Sr = (1, —2)"'", dg = (2,1)^, dg = (—1, 2)^ and (5io = (—2, —I)"*". 
The obtained results in this case are given in Fig. 2) which shows that all the followers converge to 
the convex hull spanned by the leaders and the leaders converge to the specified geometric shape 
with the desired velocity, using intermittent and delayed communication between agents. 
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Figure 1: Containment errors in Example 1 with control algorithm iITTIi-ilTa. 


8 Conclusion 

In this paper, we presented solutions to the containment control problem with multiple dynamic 
leaders for linear and nonlinear second-order multi-agent systems under mild assumptions on the 
communication and interconnection between agents. In all the proposed control algorithms, the 
information exchange is assumed to be intermittent with irregular time-varying communication de¬ 
lays and possible information losses. Our results are guaranteed under simple design conditions on 
the control parameters that can be realized independently from the characteristics of the commu¬ 
nication process and without an a priori knowledge on the general directed interconnection graph 
topology. These distinctive features make our results fundamentally different from the available 
relevant literature as discussed throughout the paper. 


A proof of Lemma [2] 

Before addressing the proof of Lemma [5J we recall some definitions on input-to-state and input- 
to-output stability notions as well as a small gain theorem proved in our earlier work |48] . Defini¬ 
tions: Consider an affine nonlinear system of the form 


X 

yj 


p 

fix) +'^9^ix)ui 

i—1 

hj{x), j = 


q, 


(46) 


17 









Figure 2: Simulation results for Example 1 with control algorithm Trajectories of the leaders (black 

dashed lines), convex hull of the leaders at different instants of time (closed shape with black sides), positions of the 
six followers (diamonds) and four leaders (circles) at instants: 0 sec (black), 10 sec (blue), 20 sec (red), and 40 sec 
(green). 


where x e Ui € R™* for i G A/’p := {1, ■ ■ ■ ,p}, Vj G for j G JVq := ,q}, and /(•), gi{-), 

for i G Afp, and hj(-), for j G Afq, are locally Lipschitz functions of the corresponding dimensions, 
/(O) = 0, h{0) = 0. We assume that for any initial condition x{to) and any inputs ui{t), ..., Up{t) 
that are uniformly essentially bounded on the corresponding solution x{t) is well defined 

for all t G [to, ti]. 

Definition 2. ^59f A system of the form (1461) is said to be input-to-state stable (ISS) if there exjsH 
j3 G /Coo OLnd 7 j € 1C, j G Np, such that the following inequalities hold along the trajectories of the 
system for any Lebesgue measurable uniformly essentially bounded inputs Uj, j G Afp: 

i) \/ to, t G R, t > to, we have 

\x{t)\</3{\x{to)\)+J2Aji sup |uj(s)| 

9 = 1 \sG[to,i) 



P / 

a) limsup|x(t)| < X] 7 i ( limsup |wj(t)| 

t —^-|-oo j = l \ t —^-j-oo 

In the above definition, 7 ^- G fC, j G Afp, are called the ISS gains. It should be pointed out that 
for a system of the form (HSl) . the ISS implies the input-to-output stability (lOS) [SS], which means 
that there exist fdi G ICC and ^ij G iC, i G Afq, j G Afp, such that the inequality 

\yr{t)\<(3i{\x{to)\,t)+^-1,A sup |uj(s)| 
holds for all i € Afq and V to, t € M, t > Iq. In this case, the function 'jij G IC, i € Afq and j G Afp, 

^ The definition of the class functions K, /Cco, and ICC can be found in |60| . Also, K := /CU{0}, /Coo := /CooUfO}, 
where O is zero function, 0{s) = 0 for all s > 0. 
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Figure 3: Simulation results for Example 1 with control algorithm (| 12 |l . and m: Trajectories of the 

followers (black dashed lines), convex hull of the leaders at different instants of time (closed shape with black sides), 
positions of the six followers (diamond) and the four leaders (circles) at instants: 0 sec (black), 10 sec (blue), 20 sec 
(red), and 40 sec (green). 


is called the lOS gain from the input Uj to the output In this paper, we mostly deal with the 
case where the lOS gains are linear functions of the form 7 ij(s) := 7 ^° • s, where 7 °^- > 0; in this 
case, we simply say that the system has linear lOS gains 7 ° > 0. 

Consider the following lOS small-gain theorem, which can be proved following similar steps as 
in the proof of [ISl Theorem 1]. 

Theorem 4. Consider a system of the form (1461) . Suppose the system is lOS with linear lOS gains 
7 ij > 0. Suppose also that each input j S Afp, is a Lebesgue measurable function satisfying: 

Uj{t) = 0, for t < 0, and 


\uj{t)\ < ■ sup \y^{s)\ + \Sj{t)\, 


(47) 


for almost all t > 0, where p,ji > 0, all ’djift) are Lebesgue measurable uniformly hounded non¬ 
negative functions of time, and dj(t) is an uniformly essentially bounded signal (uniformly bounded 
almost everywhere except for a set of measure zero). Let := • A4 G where := { 7 °^}, 

M := {fiji}, i G Afq, j G Afp. If p(f^) < 1, then the trajectories of the system (1461) with input-output 
constraints (|T7|) are well defined for allt>0 and such that all the outputs yi(t), i G Afq, and all the 
inputs Uj{-), j G Afp, are uniformly bounded. If, in addition, |(5j(t)| —>■ 0, j G Np, then \yi(t)\ 0, 

\uj(t) \ 0 for i G Afq and j G Afp. □ 

Now, we are ready to proof Lemma [2l First, note that Assumption [T] ensures that ki in ([ 8 ]) 
satisfies 7 ^ 0 for i G Also, Assumption [T] and Lemma [T] ensure that £1 is a non-singular 
M-matrix. Let 

»7c= ■= {-^f^^2®lN)r]L GM™^, 

with rja G for i G 5^ and Ci, C 2 are defined in (j^)- 
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Pil (m) 


Figure 4: Simulation results for Example 2: Trajectories of the followers (black dashed lines), convex hull of the 
leaders at different instants of time (closed shape with black sides), positions of the six followers (diamonds) and the 
four leaders (circles) at instants: 0 sec (black), 10 sec (blue), 20 sec (red), and 40 sec (green). 


Consider the error vectors 


fji — Pi Pci ; Si — 6i Pa , Ci — C* Pci 

for z e 5^, with fja '■= (Icr; ® lN)Pci G Using ([5])-([6]), we can verify that 

(48) 

Pi = -kaPi + ka5i + ^i,i-Pci 

(49) 

Ci — ^iCi kiiPa “t“ k3iSi -f Pci 

(50) 

Si = aCiCi + aCiPa + (1 - a)ei - p^ 

(51) 

where we used notation Hi — {Hi 0 /jv), Bi = {Hi (g) In), Ci = {Ci (g In) for 

simplicity. From dH]), 


it is straightforward to show that + BiSi = Bi{si — ?7cJ and = ijci, i ^ S- Also, from 

the definition of and (d])-©, one can verify that 

(r>i 0 /w)r?c = -(^2 ® lN)'nL + ® ^Jv)J7c (52) 


where we used relation Vi = Ci + Ai- Since the (z, i)-th entry of Vi is Ki, we obtain 

1 ^ 

i=l j=m+l 

Also, the input vector £;, in view of ([5]) and (H51) . satisfies 


Vci = 


m n 

ay?7j), 


(53) 


^ m n 

Ei = — ( y] Oy (i7j(tfc”(t)) + Z7c„ (tfe”(t))) + 
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for i € Then, it can be deduced from the last two equations that ei — rjc- = Ui, i € with 

^ m ^ m 

Mi = — ^ijVji^kfJt)) ~ — Mij {jlcj — Vcj i^kfjt))) 
j=l J = 1 

1 ” 

-Vjitkf^m))- (54) 

Then, the closed loop dynamics are equivalent to 

fli = -kn-fji + akn.CiCi + [l - a)kn,Ui + yi (55) 

Ci = + BiUi + Ti (56) 

with yi := - ? 7 c,, and Ti := $i _2 - Vci for i S 5^. 

In view of (I48L the results of Lemma[2]can be verified if the error vectors fji, i G and their first 
time-derivatives are uniformly bounded and converge asymptotically to zero. This can be shown 
using the result of Theorem |4] as follows. First, one needs to show that the overall system that 
consists of all systems (1551) - (1551) . i G ^,is lOS with respect to some appropriately defined input and 
output vectors, and, in addition, the input vectors satisfy property (liTI) in Theorem S] Note that 
all systems (l55l) - (|56)) . i G are interconnected through the input vectors Ui, i S U, given in (|54l) . 
Then, if one can obtain explicit expressions of the lOS gain matrix and the interconnection 
matrix Ai defined in Theorem [4l our objective can be shown under the conditions of Theorem HI 
p(i#) < 1 where • A4 is the closed loop gain matrix. 

Consider each system (l55)l - (l56l) for i G and let Q := , ■. ■, Ci>i)''' £ and := 

(Xy,..., Xyj^ G , with G and G , for £ = 1,..., Ci and i G 5. Exploiting 
the structure of Hi, Bi, and Ci in ([9]), one can show that the following estimates 

|l?i(t)l < |f?i(to)|+a sup (|Ci.i(?)|) 

-t(l-a) sup (|Mi(?)|) -t 7 ^ sup (|Ti(?)|), (57) 

‘re[to,‘l <:6[to.t] 

\Ci,eit)\ < \Ci,t{to)\ + sup (|Ci/-i-i(?)l) 

+ 77“ sup (|Ti,i(?)|), (58) 

<re[to,il 

for .^ = 1,..., tTi — 1, and 

|c,i^i(^)| < + ^ |Ci,cri(to)| -I- sup (lui)?)!) 

+ T-^ sup (|Ti,,j,(?)|) (59) 

hold for all t > to > 0 and 7 G (?. The above inequalities show that each system dSSli-dMl), 
7 G is a cascade connection of Ui + 1 subsystems, where each subsystem is ISS. Therefore, each 
system (1551)-(1551). for 7 G S', is also ISS with respect to the inputs Ui, Ti, and the components of 
Ti. Consequently, the system (1551) - (1551) with output rji can be shown to be lOS with respect to 
the same input vectors, in particular, the lOS gain with respect to the input Ui is equal to 1 for 
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both values of a. As a result, if one considers the overall system that consists of all the systems 
(ESI)-(ESI), i € S', with the m outputs fji and the m inputs Ui, i one can verify that thus defined 
system is lOS with the lOS gain matrix = Im- Note that does not relate the outputs fn to 
the inputs and T^, i € S, which does not affect our analysis. In fact, one can show, using 

Vc = ( 60 ) 


that yi and T^, i G S, are uniformly bounded and converge asymptotically to zero if 
i S S, and i S £, are uniformly bounded and converge to zero. 

Now, we derive estimates of the inputs Uj, i € S, given in (EH)- In view of (|5S1) and the fact 
that {t — t/cm(t)) < T* (by Assumption E]) , it can be verified that 


/ t ^ m 1 " 

— Yl (“?) + — Y “b' Vj (^) 

j=i i=m+l 

^ m 

-b—sup (|r7j(0l) 

^ m 

<—y'aii sup (|i 7 j(c)|)-f |Ai|, 

® j=i 




( 61 ) 


with|Aj|:=r* sup (|?)ci(?)|)- 
(*)■*] 

Then, the input vector Ui, i G S, of system (ESJ-lES]) satisfies the conditions of Theorem [4] with 
the elements of the interconnection matrix M := {/ijj} G being obtained as ^ for 

i, j G (?. This, with ((I])-(I1)), lead to the closed-loop gain matrix 

^ :=^o =p-Mi. ( 62 ) 

Using the definition of £i Vi — Ai, we know that V^^Li = I^—^. Since £i is a non-singular 
M-matrix, by Assumption [T] and Lemma [U and is a diagonal matrix with strictly positive 
diagonal entries, it is straightforward to verify that {Im. — '^) is also a non-singular M-matrix (see 
Definition [1} and hence p(f^) < 1, which satisfies the condition in Theorem |4l 

Note that for all (i,j) G £, Assumption E] ensures that {t — tfc“(t)) is bounded and satisfies 
{t — tfeg(t)) A T*. Then, in view of the lOS property of each system (1551) - (I5S1) . i, G (?, TheoremE] 

can be used to show that fji, fji, Q, Q, and Ui, for i G 5^, are uniformly bounded provided that |Ai|, 
with yi and Tj, i G U, are uniformly bounded. We can verify that the latter conditions are satisfied 
under the conditions of item i) in Lemma El In particular, relation ( 1601 ) with Assumption [T] imply 
that |Ai|, z G (?, is uniformly bounded if fji := z G £, is uniformly bounded. As a result, we 
conclude that zy^, zy^, Cg Cg for z G (? are uniformly bounded. Also, it can be verified from (H51) and 
EOl) that fji and C,i, z G S', are uniformly bounded. This proves statement z) in the lemma. 

Using similar arguments as above, we can show that |Ai(t)| —>-0, z G S, under the conditions 
of item a) in Lemma El Also, A’i(t) —>■ 0 and Ti(t) ^ 0, z G S, under the same conditions. Then, 
Theorem El with the lOS property of systems EB-Eni), can be used to show that fii{t) — 5> 0 , 
fli{t) 0, C,i{t) 0, and C,i{t) —>■ 0, z G S, which leads to the conclusions in item zz) in the lemma. 

Finally, let us consider the case where ^i^ 2 , * G S, and z G £, are uniformly bounded 
but do not converge to zero. We can deduce from (I571) - (l5ni) and (ITOt - dCT) that the effects of non-zero 
perturbation terms $^ 4 , $^^ 2 , * G S, and z G £, on the states of system (I551) - (I551) can be reduced 
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with a choice of the gains provided that T* is small and/or rij^ is a slowly varying signal. In fact, 
it can be verified, form (l57ll - (l59)) . that the effects of Ti := — (l^i ® lN)Vci (in the case a = 1) 

and yi := <I>ip — rja can be arbitrarily reduced, respectively, with a choice of the entries of the gain 
matrix Hi and the gains . In addition, it can be verified from (IbTI) that |Ai(t)|, i e 5" is small 
for small values of T* and/or small values of |?7ci |, * G 5^, where, in view of (1601) . |? 7 cJ depends on 
\f]i\ = jdtjl, f g £. The proof is complete. 
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